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ABSTRACT 



A method and apparatus for applying coded data to a 
substrate and decoding the data in which the data are 
encoded in cells having a determined number of pixels. 
The pixels arc coded, preferably by binary printing, in 
accordance with the number of coded pixels and not 
their position. In decoding of the cells, the gray scale 
levels of the pixels are sensed, and converted to digital 
signals. The digital signals are summed, for all of the 
pixels of the cell, and compared with multiple threshold 
levels in order to recover the data. 

8 Claims, 3 Drawing Sheets 
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properly oriented marking corresponds to a 1, whereas 
MULTIPLE THRESHOLD ENCODING OF a cell with no darkened pixels corresponds to a 0. With 

MACHINE READABLE CODE this encoding, it is apparent that the illustrated 8 cells 

(128 pixels) of FIG. 6 corresponds to binary 01111001, 
FIELD OF THE INVENTION 5 or de cimal 121. 

This invention relates to a method and apparatus for While the provision of a hardcopy in which pixels of 
the recording and reading of encoded digital data on an image may intentionally have more than two gray 
hardcopy recording media and, more particularly, to levels is known, for example in U.S. Pat. Nos. 4,788,298 
the use of codes composed of a plurality of cells each and 4,790,566, such techniques are not employed in a 
having a plurality of pixels. 10 manner to reduce the area of the hard copy that must be 

BACKGROUND OF THE INVENTION employed for encoding functions. 

Plain paper is a favored recording medium for storing SUMMARY OF THE INVENTION 

and transferring human readable information, and the -j^ present invent i on j s directed to the provision of 
emergence of electronic document processing systems fl method ^ tus for encoding and decoding of 
has enhanced the functional utility of plain paper and dalfl on hard that enables the emdcnt md reli . 

other types of hardcopy documents by enabling the . , „r „,wi» ~ i Q 

application of machine readable digital data thereon. able 7° vc ? ° f thc whJc ™P^ymg * minimum 
This machine readable data enables the hardcopy docu- area ottne nara copy. 

ment to actively interact with such a document process- * B ™? v ^ m accordance with the invention, a 
ing system in a variety of different ways when the docu- method *» d apparatus are provided for encoding data 
ment is scanned into the system by an ordinary input on a substrate and decoding the coded data, wherein the 
scanner. See, for example, the copending and com- data is in the form of a plurality of cells on the substrate, 
monly assigned U.S. patent applications of Frank Zdy- and each cell has a predetermined number of pixel loca- 
bel, Jr. et al. and Walter A. L. Johnson et al., which 25 tions. The encoding is effected by marking a number of 
were filed May 30, 1990 on "Hardcopy Lossless Data the pixels, preferably by binary marking, the number 
Storage and Communications for Electronic Document corresponding to the data to be encoded. The relative 
Processing Systems" (D/89190) and on "Form and location of the marked pixels in a cell does not consti- 
System Utilizing Encoded Indications for Form Field t u t e a part of the encoding. 

Processing" (D/90003), respectively. 30 In order t0 decode ^ markings on the substrate, the 

As a general rule, digital data is recorded by writing gray scale leve i at each pixe j of the is detected and 
two dimensional marks on a recording medium in ac- converted t0 a corresponding digital signal. The digital 
cordance with a pattern which encodes the data either ${ . corresponding to aU of the pixe ls in the cell are 
by the presence or absence of marks at a sequence of simi med 

spatialJocations or by the Presence or absence of mark 35 ^ ^ m ^ 

related transitions at such locations. Ordinary magnetic ,.«.....,,. *u . ^ „ 

and optical digital data recording conform to this style div.dmg the munnum range of po able sums 

of encoding mt0 SUDran 8 es ' and tnc sum of ^ digital signals is 

In a prior method and apparatus for encoding ma- compared with the threshold values to determine the 
chine readable information on a paper document, as 40 subrange within which the sum falls. The threshold 
disclosed for example in copending U.S. patent applica- levels are set so that the subranges correspond to the 
tion Ser. No. 07/560,514 filed July 31, 1990 "Self-clock- expected sums when corresponding numbers of pixels 
ing Glyph Shape Codes", Bloomberg et al, the contents are marked. Accordingly, a signal corresponding to a 
of which are incorporated by reference herein, an en- determined subrange is output, to correspond to the 
coded pattern is scanned by a CCD input scanner, digi- 45 encoding of the cells, 
tired, and binary thresholded. In binary thresholding „„™ rT ^ T ^ T „ ____ A 

methods, all printed pixels with a digitized value greater BRIEF DESCRIPTION OF THE DRAWING 

than the threshold are interpreted as being 0's, and all T n or( j er that the invention may be more clearly im- 
printed pixels with a digitized value equal to or less than derstood, it will now be disclosed in greater detail with 
the threshold value are interpreted as l's. In the above 50 re f ere nce to the accompanying drawing, wherein: 
system, the encoding methods thus use binary thre- FIG. 1 is a simplified block diagram of an electronic 
sholding of the signal read from the encoded pattern. do c Umen t processing system for carrying out and tak- 
For example, if a pattern consists of 16 printed pixels for . advantage of the various ^ptcis of the present in- 
each encoded bit, the digitized CCD output of the scan- VC n t j on . 

ner is binary thresholded and then the interpreting 35 piG ; 2 fa functiona , block di of a ^ ica] 
algonthm determines whether the 16 pixel ^ h« « J cessor/printer interface for the document processing 
pixel black slash in it. If there is no slash, the pattern is *u nu , n ;„ x:ir i 

interpreted as encoding a 0. The above system also sys ^ m s i lown .„ ri °*. x; f . 

imcipivicu « cm^uuit « cW> , oc ^ F A :tr* r FIG. 3 is an illustration of an image cell m accordance 

suggests an encoding scheme wherein slashes of diner- . ° 

ent directions are used to differentiate between a 0 and 60 w "h one embodiment of the invention; 

a 1. In such arrangements, the analog output is digitized FIG. 4 is an illustration of a group of image cells in 

and then binary thresholded. accordance with the embodiment of the invention of 

An example of the encoding system of the above FIG. 3; 

system is shown in FIG. 6 wherein each cell of the FIG. 5 is a simplified flow diagram of the method of 

image is a 4X4 matrix of pixels. The encoding of each 65 the invention; and 

cell consists in defining a diagonal marking in the cell, in FIG. 6 is an illustration of a group of image cells in 

the form of black image of 8 pixels, in a rotationally accordance with patent application Ser. No. 07/560,514 

dependent manner. Accordingly, a cell having such a as prior art. 
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DETAILED DISCLOSURE OF THE INVENTION 

Referring now to the drawings, FIG. 1, illustrates an 
electronic document processing system 21 which may 
constitute a typical environment for this invention. In 
keeping with standard practices, the document process- 
ing system 21 comprises a digital processor 22 having a 
main memory 23 and a mass memory 24, an input scan- 
ner 25 for scanning digital representations of selected 
hardcopy documents into the processor 22, and a 
printer 26 for printing hardcopy renderings of selected 
ones of the files that are listed on a file directory (not 
shown) of the processor 22. A user interface 27 is pro- 
vided for enabling a user to interact with the processor 
22, the input scanner 25, and the printer 2*. The proces- 
sor 22 sets operations including setting thresholds, sum- 
ming digital signals, and comparing the sum to the 
thresholds. 

The user interface 27 collectively represents the input 
devices through which the user enters control instruc- 
tions for the input scanner 25 and for the printer 26, as 
well as the image editing and manipulation instructions 
for the processor 22. Additionally, the interface 27 rep- 
resents the output devices through which the user re- 
ceives feedback with respect to the actions that are 
taken in response to the instructions that are entered by 
the user or otherwise, such as under program control. 
For example, the user interface 27 generally includes a 
keyboard or the like for entering user instructions, a 
monitor for giving the user a view of the process that is 
being performed by the processor 22, and a cursor con- 
troller for enabling the user to move a cursor for mak- 
ing selections from and/or for entering data into a pro- 
cess that is being displayed by the monitor. Since these 
components are conventional they are not illustrated 
herein. 

The illustrated document processing system 21 is 
centralized, so it has been simplified by assuming that all 
control instructions and all image editing and manipula- 
tion instructions are executed by the processor 22 under 
program control. In practice, however, the execution of 
these instructions may be handled by several different 
processors, some or all of which may have their own 
main memory and even their own mass memory. Like- 
wise, either or both of the input scanner 25 and the 
printer 26 may have its own user interface, as indicated 
by the dashed lines 28 and 29, respectively. Indeed, it 
will be evident that the document processing system 21 
could be reconfigured to have a distributed architecture 
to operate with a remote input scanner and or a remote 
printer (not shown). Data could be transferred from and 
to such remote scanner and printer terminals via dedi- 
cated communication links or switched communication 
networks (also not shown). 

The input scanner 25 may include a CCD 25A for 
scanning a hardcopy input document. The CCD is con- 
trolled by the processor 22 to selectively apply its out- 
puts, corresponding to the different printed pixels, to an 
A/D converter 25B. The digital outputs from the A/D 
are stored in a memory of the system. The scanner is 
controlled by the program of the processor to scan the 
image of each hardcopy input document at a predeter- 
mined spatial resolution of, say, 300 s.p.i.X300 s.p.i. 
(spots/inch). In operation, the CCD 25A converts the 
gray level of the individually resolved picture elements 
(commonly called "pixels" or "pels") of the scanned 
image into corresponding analog values and the A/D 
converts these values to digital values for application to 



400 

4 

the processor and suitable storage. For the purposes of 
this example, it is assumed that the printed pixel spatial 
resolution is equal to the CCD pel resolution (e.g. 300 
spi by 300 spi) and that the program controls the main- 

5 tenance of the alignment of the printed pixels with the 
array of the CCD pels. 

The printer 26, on the other hand, generally is a so- 
called bitmap printer for mapping the digital values of a 
bitmapped image file into the spatially corresponding 

10 pixels of the image it prints on a suitable recording 
medium, such as plain paper. The processor 22 may be 
configured to manipulate and store bitmapped image 
files and to transfer such files on demand to the printer 
26. Alternatively, however, as shown in FIG. 2, the 

15 processor 22 may include a PDL (page description 
language) driver 31 for transferring to the printer 26 
PDL descriptions of the electronic document files that 
are selected for printing. Thus, the printer 26 is illus- 
trated as having a PDL decomposer 32 for decompos- 

20 ing such PDL descriptions to produce corresponding 
bit-mapped image file. Still other types of printers and 
processor printer interfaces will suggest themselves, but 
it will be assumed for purposes of the following discus- 
sion that the printer 26 is a bitmap printer that receives 

25 PDL files from the processor 22. 

CODING OF DATA 

In accordance with one aspect of the invention, the 
image to be printed on hardcopy is separated into cells, 

30 each of which contains a predetermined number of 
pixels. For example, a cell 30 may include 6 pixels ar- 
ranged in a 2X3 array, as illustrated in FIG. 3. The cell 
is encoded by distinctively marking the pixels. For ex- 
ample, a predetermined number of the pixels, from 0 to 

35 6, may be printed to be black, while the remaining pix- 
els, if any are white. Accordingly, there are seven possi- 
ble black-white combinations of the pixels of the cell. 
Insofar as the present invention is concerned, the spe- 
cific location of the black pixels in each cell is not mate- 

40 rial, i.e. the encoding of the invention is concerned only 
with the number of distinctly marked pixels, and not 
their relative locations. The cell of FIG. 3 is thus illus- 
trated to show a cell in which 4 of the 6 pixels are 
marked. It will be understood, of course, that the inven- 

45 tion is not limited to the provision of cells of 6 pixels, 
and that either a greater number or a lesser number may 
be employed. 

It will be further understood that characteristics of 
the marking of the marked pixels, such as their color 

50 and reflectivity, are preferably the same, i.e. there is no 
intentional variation in the detection characteristics of 
the marked pixels. For example, as illustrated in FIG. 5, 
in block 50 the coded image cells are preferably binary 
printed on the substrate or hardcopy, rather than being 

55 printed at different gray scale levels. This technique 
results in more robust printing, and the printed code is 
less sensitive to illumination and process non-uniformi- 
ties. 

In accordance with the invention, since a multiple 
60 pixel cell is printed with binary printing, rather than 
printing a single pixel cell with gray scale coding, the 
error rate on scanning of the cell is substantially re- 
duced. In addition, as will be described, the invention 
takes advantage of the gray levels available in a scan- 
65 ning CCD output signal, e.g. 128 gray levels. 

FIG, 4 illustrates the combination of 3 cells 30, each 
having 6 pixels in accordance with the arrangement of 
FIG. 3. Since each of the cells may correspond to any of 
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7 distinct non-spatially sensitive outputs, it is evident 
that the combination of 3 cells of FIG. 4, corresponds to 
any of 7 3 difFerent outputs, e.g. any value from 0 to 343. 
as a consequence, the present encoding system enables 
the encoding of more than the 256 ASCII character set 5 
with only 18 pixels. As will be discussed, the pixel rep- 
resentation of FIG. 4 may correspond to the number 
"121". This contrasts, for example, with the rotationally 
variant binary thresholding encoding scheme of appli- 
cation Ser. No, 560,514, as illustrated in FIG. 6, wherein 10 
it was necessary to employ 128 pixels to represent the 
same decimal number. 

DECODING OF DATA 

In accordance with the invention, multiple threshold 15 
levels of the digitized CCD output are provided for 
increasing the information storage density in a reliable 
manner. As discussed above, the output of the CCD 
25A corresponds to the gray scale level of the sensed 
pixel, as indicated in FIG. 5 at block 51. This output is 
directed to an A/D converter 25B, as indicated at block 
52 of FIG. 5. As an example, if the system uses an 8 bit 
A/D converter, the 8 bit output of the converter can 
represent any integer from 0 to 255. If one of the bits is 
discarded due to noise, the remaining 7 bits of the A/D 
output can represent any integer from 0 to 127. 

Accordingly, in this example, the analog signal out- 
put of the CCD, corresponding to each scanned pixel, 



TABLE 1 


Threshold Level 


S Value 


Corresponding 


(Equal to or 


(within the 


Output (Number of 


less than) 


range) 


Black Pixels) 


63 


0-63 


6 


190 


64-190 


5 


317 


191-317 


4 


444 


318-444 


3 


571 


445-571 


2 


668 


572-668 


1 


762 


669-762 


0 



20 



25 



As illustrated in FIG. 5, at block 54 a comparison is 
made between the threshold values and the sum S to 
determine the range into which the sum S falls, and at 
block 55 a signal corresponding to this determined 
range is output, and constitutes the decoded value of the 
cell. 

It is noted in the example of Table 1 that the multiple 
threshold levels need not be equally spaced in the full 
range of values. 

It is of course apparent that the above disclosure has 
been directed primarily to the explanation of the encod- 
ing method and apparatus specific to the invention, and 
that conventional techniques may be employed there- 
with in the printing of the pixels, sensing of the pixels, 
correction for scale or skew or the like and processing 
of the data. 

While the invention has been disclosed and described 



may be converted into a digital number representing ^ ^ reference to a single embodiment, it will be appar- 
any decimal value from 0 to 127. 

As in the example of FIG. 3, assume that the pixels 31 
of a cell 30 are arranged in a 2x3 array. As discussed 
above, in such an array there are 7 possible distinguish- 
able output levels from the CCD scanning each cell 35 
(assuming that the pixels of the cell are binary marked), 
depending upon the number of pixels that are black (or 
have other distinctive marking), i.e. from 0 to 6 pixels 
may be black. 

In accordance with the invention, in order to avoid 40 
dependence upon the sensing of each marked pixel as 
having a gray scale level that is either above or below a 
single threshold value, the digital values corresponding 
to all of the pixels of the cell are summed, to provide a 
sum S, as indicated at block 53, and the sum S of the 45 
sensed levels is tested at multiple threshold values, as 
indicated at block 54. 

For example, if the cell of an image has N pixels, and 
the gray scale level of each pixel of the cell is converted 
to an L bit digital signal representing the gray scale 50 
level of the respective pixel, the digital signal corre- 
sponding to each pixel may have a maximum of 2 l 
different values, and the sum S of the detected levels 
may have a maximum value of Nx(2 I — 1). 

In this example, N different threshold levels are de- 55 
fined, separating said maximum value NX(2 L - 1) into 
N+l level ranges. 

Thus, in a numerical example, if the cell has 6 pixels, 
it has N+l =7 different black/white combinations. If 
the digital signal has L=7 bits, the digital signal has V 60 
or 128 possible levels, or 0 to 127. The maximum possi- 
ble sum S is then 127x6=762. 

The threshold levels are selected in order to provide 
the maximum possibility that the range of values within 
which the sum S falls corresponds to the actual number 65 
of pixels that are distinctively marked (i.e. are black). In 
the above example, the following threshold ranges may 
be employed: 



ent that variations and modification may be made 
therein, and it is therefore intended in the following 
claims to cover each such variation and modification as 
falls within the true spirit and scope of the invention. 
What is claimed is: 

1. A method for decoding a cell of an image having a 
plurality of pixels, comprising: 

(a) detecting the gray scale level at each pixel of the 
cell an converting each of the detected gray scale 
levels to a digital signal representing the detected 
gray scale level of the respective pixel, 

(b) dividing the maximum output range of said de- 
tected gray scale levels into a plurality of contigu- 
ous signal level ranges, 

(c) summing the values of the detected digital signals 
corresponding to the gray scales of the pixels of the 
cell, and comparing said sum with a plurality of 
threshold levels to determine the level range within 
which the sum S falls, whereby the determined 
signal range represents the coding of the cell, and 
outputting a signal corresponding to said range. 

2. A method for decoding a cell of an image having N 
pixels, comprising: 

detecting the gray scale level of each pixel of the cell 
and converting each of the detected gray scale 
levels to a L bit digital signal representing the gray 
scale level of the respective pixel, wherein N and L 
are integers; whereby the digital signal correspond- 
ing to each pixel may have a maximum of 2 L differ- 
ent values; 

summing the digital signals representing all of the 
pixels of the cell, whereby the resultant sum S may 
have maximum value of N X (2^— 1); 

defining N different threshold levels separating said 
maximum value into N + l level ranges; 

comparing said sum S with the threshold levels to 
determine the level range within which said sum 
falls; and 
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outputting said determined level range, whereby said 
determined level range corresponds to the coding 
of pixels of said cell. 

3. A method for coding information on a substrate, 
comprising 5 

defining an image cell of a predetermined number N 

of pixels on said substrate, 
selectively correlating information to be encoded to 

different numbers M from 0 to N, and 
distinctively marking M of said pixels on said sub* 10 

strate, with respect to the remaining pixels thereof, 

irrespective of the relative location of the marked 

pixels in the cell. 

4. The method of claim 3 wherein said step of mark- 
ing comprises binary printing said pixels on said sub- 15 
strate. 

5. A method for encoding data on and recovering it 
from a substrate, comprising marking pixels of a cell on 
said substrate with binary printing; 

sensing the gray levels of said pixels and converting 20 
the sensed levels to digital signals; 

summing said digital signals, and comparing the sum 
thereof with a plurality of different threshold lev- 
els, to determine a range of levels within which 
said sum falls; and 25 

outputting a signal corresponding to said determined 
range. 

6. An apparatus for decoding a cell of an image hav- 
ing a plurality of pixels, comprising: 

30 



8 

means for detecting the gray scale level at each pixel 
of the cell; 

means for converting each of the detected gray scale 
levels to a digital signal representing the detected 
gray scale level of the respective pixel, 

means for defining a plurality of threshold levels; 

means for summing the values of the detected digital 
signals corresponding to the gray scales of the 
pixels of the cell; 

means for comparing said sum with said threshold 
levels to determine a level range within which said 
sum falls, whereby the determined signal range 
represents the coding of the cell, and 

means for outputting a signal corresponding to said 
determined range. 

7. An apparatus for coding information on a sub- 
strate, comprising 

means for defining an image cell of a predetermined 
number N of pixels on said substrate, 

means for selectively correlating information to be 
encoded to different numbers M from 0 to N, and 

means for distinctively marking M of said pixels on 
said substrate, with respect to the remaining pixels 
thereof, irrespective of the relative location of the 
marked pixels in the celt. 

8. The apparatus of claim 7 wherein said means for 
marking comprises means for binary printing said pixels 
on said substrate. 

***** 
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